Recently, the research team at Meta Reality Labs has jointly released an innovative generative model called 'Pippo', which can generate a dense turnaround video with a resolution of up to 1K from a randomly taken photo. This breakthrough technology marks another significant advancement in the fields of computer vision and image generation. The core of the Pippo model lies in the design of its multi-view diffusion transformer. Unlike traditional generative models, Pippo does not require any additional inputs, such as fitted parameters.

PanoFree is an innovative multi-view image generation technology that can produce various panoramic images, including long images, 360-degree panoramas, and skyboxes, without the need for fine-tuning. Its core lies in addressing consistency issues and artifacts during the generation process through an iterative deformation and repair process while enhancing cross-view awareness. PanoFree employs techniques such as cross-view guidance, risk area estimation, erasure, and symmetric bidirectional guidance, combined with guided semantic and density control to ensure the preservation of scene structure. Experiments show that PanoFree achieves ...